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ABSTRACT 



We present some properties of the gradient of a mu-differentiable function. The Method of 
Lagrange Multipliers for mu-differentiable functions is then exemplified. 
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1 Introduction 

In pQ we introduce a new kind of differentiation, what we call mu-differentiability, and we 
prove necessary and sufficient conditions for the existence of extrema points. For the necessary 
background on Nonstandard Analysis and for notation, we refer the reader to [T] and references 
therein. Here we just recall the necessary results. 

Definition 1.1. [I] Given an internal function / : *R n — > *R, we say that a G W 1 is a local 
m-minimum of / if 



where r £ 1 is a positive real number. 

The crucial fact is that there exists a relationship between m-minimums and minimums: 
Lemma 1.1. JTJ/ // / : *R n — > *R is mu-differentiable, then 

a is a m-minimum of f if and only if a is a minimum of st(f). 
With this lemma, and using the fact that 
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f(x) > f{a) for all x E *B r {a) 




(1.1) 



it follows: 



Theorem 1.2. PS If f : 

f , then 



df_ 

dxi 



is a mu-differentiable function and a is a m-minimum of 
~ 0, for every i = 1, 



, n. 



In this paper we develop further the theory initiated in pQ, proving some properties of the 
gradient vector (section [2]) and a Method of Lagrange Multipliers (section [3|). Illustrative 
examples show the analogy with the classical case. 

2 The Gradient Vector 

In the sequel / denotes an internal mu-differentiable function from *M n to *R. 
Definition 2.1. A gradient vector of / at x G ns(*K n ) is defined by 



where 
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and e is an infinitesimal satisfying |e| > Sf. 

Remark 2.1. The positive infinitesimal 5f that appears in Definition 12.11 is given by the m- 
differentiability of / (cf. pQ). 

Remark 2.2. Observe that 

Df x (e l ) 



df_ 

dxi 



where ej = (0, . . . , 0, 1, 0, . . . , 0) denotes the ith canonical vector, and Df x denotes the derivative 
operator of / at x. 



Theorem 2.1. If x,y G ns(*M n ) and x~y, then 

, i = 1, . . . ,n, 
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i.e., V/(x) « V/(y). 

Proof. Simply observe that Df x {ei) w Df y (ei). 

Theorem 2.2. If u £ *M n is a finite vector, then 

Vx G ns(*M") D/ x («) w V/(x) • u. 

Proof. Since st(f) is a C 1 function, if follows that for any v G M n 

Dst(f) st{x) (v) =Vst(f)(st(x)) • v. 

By the Transfer Principle of Nonstandard Analysis, it still holds for u G 
hand, 



□ 



On the other 



1. Dst(f) st[x) {v) = st(Df st{x) ){u) « Df x (u), 



2. Vst(f)(st(x)) = st(Vf(st(x))) « V/(x), 

which proves the desired. □ 

We point out that, in opposite to classical functions, if V f(x) is a gradient vector of / at x, then 
V/(x) + O, where G *M n is an infinitesimal vector, is also a gradient vector at x. Conversely, 
if V/(x) and V 1 f(x) are two gradient vectors, then V/(x) — V 1 f(x) « 0. 
From now on, when there is no danger of confusion, we simply write V/ instead of V/(x). 

Example 2.1. Let f(x,y, z) = (l+e)xy 2 — 5z, with (x, y, z) G *]R 3 , and e and <5 be two infinitesimal 
numbers. Given an infinitesimal 0, 

(l+6)(x + % 2 -fe-((l + 6)x/-fc) , 



:i +e M y+ ^- fe -((i +e) v- fa ) = 2(1+e)ay+ , (1+e)a , 



(1 + e)xy 2 - 5(z + 6) - ((1 + e)xy 2 - 5z) 

o = 

and we can choose 

d~x = {l + e)y ^y =2{l + e)XV ' d~z = - 6 - 
Theorem 2.3. If f and g are mu-differentiable and k G fin(*M), then 

V(kf) = kVf, V(f + g)=Vf + Vg, and V(fg) = fVg + gVf. 

Proof. We prove only the last equality. Fix an infinitesimal number e such that |e| > Sf. Then, 

9(fg) (fg)(xi,...,Xi-i,Xi + e,x 
dxi e 

di^l > • • • ) 1) Xi -\- 6, Xj_)_i , . . . , x n ) dip^l ! ■ • • ) *^n) 



/(xi , . . . , x n ) - 



~l - fi'(^'l) ■ ■ ■ ) ^i— 1; "I - £j • • • j fn) 



e 

/(xi, • • • , Xj_i, Xj -|- e, Xj-|_i, • • • , x n ) /(xi, • • • , x n ) 



" /(x) ^- + 5(x) 9x7 

by the continuity of g. □ 

Definition 2.2. We say that x is a m-critical point of / if V/(x) ~ 0. 

The following lemma is an immediate consequence of (jl.ip and Definition 12.21 

Lemma 2.4. A point x is a m-critical point of f if and only if st(x) is a critical point of st(f). 
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3 The Method of Lagrange Multipliers 



Let / : *R n — > *R and gj : *R n — >■ *R, j = 1, . . . ,m (m G N, m < n), denote internal mu- 
differentiable functions. We address the problem of finding m-minimums or m-maximums of 
/, subject to the conditions gj(x) ~ 0, for all j. The constraints gj(x) « 0, j = 1, . . . , m, 
are called side conditions. Lagrange solved this problem (for standard differentiable functions), 
introducing new variables, Ai, . . . , A m , and forming the augmented function 

m 

F(x, Ai, . . . , A m ) = /(x) + A i5i (x), x g R n . 

3=1 

Roughly speaking, Lagrange proved that the problem of finding the critical points of /, satisfying 
the conditions gj(x) = 0, is equivalent to find the critical points of F. We present here a method 
to determine critical points for internal functions with side conditions, based on the Method of 
Lagrange Multipliers. Similarly to the classical setting, define 

F : 



(xi,...,x n ,Xi,...,X m ) h-> f(x 1 , ... ,x n ) + y~]Xjgj(xi, . . . ,x n ). 

3=1 

If we let g := (g±, . . . , g m ) and A := (Ai, . . . , X m ), we can simply write 

F(x, A) = f(x) + A • g(x) . (3.1) 

Theorem 3.1. [Lagrange rule in normal form with one constraint] Let f : *R n — > *R and 
g : *R n — > *R be two mu- differentiable functions, and a a m-minimum of f such that g{a) ~ 
and V g{a) 96 0. Then, there exists a finite A G *R such that 

V/(a) + XVg(a) « 0. 

Proof. Since st(f) and st(g) are functions of class C , a is a minimum of st(f), st(g)(a) = 
and Vst(g)(a) / 0. It follows (see, e.g., p. 148]) that 

3XeR Vst(f)(a) + XVst(g)(a) = 0. 

Hence, 

V/(a) + AV 5 (a) « 0. 

□ 

Remark 3.1. Suppose that we are in the conditions of Theorem 13.11 Then, there exists some 
Ai G fin(*R) such that 

V/(a) + AiV<?(a)~0, 



z.e., 

a/ 

Ox,; 



OXj 



a 0, i = 1, . . . ,n. 
Using the notation (|3.ip . if a is a m-minimum of / and g(a) ~ 0, then 



Consequently, the m-critical points are solutions of the system 

dF , dF 

— ps 0,i = 1, . . . , n, and — ps , 
axi aA 

i.e., VF ps 0. 

Example 3.1. Let f(x,y,z) = xyz + e, with e « 0, and consider the constraint g(x,y, z) 
x 2 + 2(y + 5) 2 + 3z 2 — 1, with £ ps 0. In this case, we define 

F(x, y, z, A) := xyz + e + A(x 2 + 2(y + J) 2 + 3z 2 - 1). 

The system (13. 2D takes the form 

yz + 2Ax pa 
xz + 4A(y + 5) ps 
xy + 6Az ps 

x 2 + 2(y + <5) 2 + 3z 2 -lPs0. 
Since 

xyz ps -2Ax 2 ps -4Ay(y + 5) ps -6Az 2 , 

if A ps 0, the solution is 

2^1 2^1 i 2^1 

x ps -, y ps - and z ps - ; 
3' y 6 9 

if A ps 0, then 

1\ / 1 



0,0,±^=J, {0,±-j=,0j and (±1,0,0) 
are solutions. Observe that 

Vy = (2x, 4(y + (5), 6z) ps (0, 0, 0) if and only if (x, y, z) ps (0, 0, 0). 
One easily checks that 

f ( —= , —= , - | = — — + e is the m-maximum and 
VV3V6 37 3^/18 

f ( = , — = , — | = = + e is the m-minimum 

V V3 V6 37 3^ 

of / subject to the constraint y. 

We now prove a more general Lagrange rule, admitting possibility of abnormal critical points 
(/i = 0) and multiple constraints. 

Theorem 3.2 (Lagrange rule). Let /, yi, . . . ,g m be mu-differentiable functions on *M n . Let a 
be a m-minimum of f satisfying 

yi (a) ps ... ps g m (a) ps 0. 
Then, there exist finite hyper-reals fi, Ai, . . . , A m G *R, no£ a// infinitesimals, such that 

yV/(a) + AiVyi(a) + . . . + A m Vy m (a) ps 0. 
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Remark 3.2. Defining F(x,fi,X) := fJ<f(x) + A • g(x), the necessary optimality condition given 
by Theorem 13.21 can be written as dF/dx ps dF/dX ps 0. 

Proof. First observe that st(f), st(gi), . . . , st(g m ) are all functions of class C , Vst(f)(a) = 
st(Vf)(a) and Vst(y.,)(a) = st(Vgj)(a), for j = 1, . . . ,m. Furthermore, since a is a minimum 
of si(/) and 

s£(#i)(a) = . . . = st(g m )(a) = 0, 
there exist reals /x, Ai, . . . , A m , not all zero, such that 

fiVst(f)(a) + AiVst(0i)(a) + . . . + A m Vsi( 5m )(a) = 
(see, e.g., [21 p. 148]). Consequently, 

H st(V/)(a) + Aist(V<7i)(a) + . . . + A m si(V 5m )(a) = 0. (3.3) 
On the other hand, we have 

»st(Vf)(a) =fist(Vf(a)) ps f*V/(a). 
Analogously, for each j = 1, . . . , m, 

\jSt(X7gj)(a) ps XjVg^a). 
Substituting on equation (|3.3|) the previous relations, one proves the desired result. □ 

Example 3.2. Let f(x, y, z) = z 2 /2 — (x + e)y, with e ~ 0, be the function to be extremized, and 
gi(x, y, z) = x 2 + y — 1 and g2(x,y,z) = x + z — 1 + S, with 5 ps 0, be the constraints. Then, 
the augmented function is 

F(a?, y, z, Ai, A 2 ) = /U [z 2 /2 - (s + e)y] + Ai(x 2 + y - 1) + A 2 (x + z - 1 + 5). 

To find the local extrema of /, subject to the conditions g\ ~ and y 2 ~ 0, we form the system 

— fiy + 2X\x + A 2 ~ 
-fi(x + e) + \i » 
< / uz + A 2 «0 (3.4) 
x 2 + y - 1 Pa 

of necessary optimality conditions. Assume ps (abnormal case). Then, the first two equations 
in (|3.4p imply immediately that Ai ps A 2 ps 0. This is not a possibility by Theorem 13.21 We 
conclude that /i 96 0. The solutions of (|3.4|) are then infinitely close to the vectors 

(-1,0,2) and (2/3,5/9,1/3). 

Hence, if / has any m-extrema under the given constraints, then they must occur at either 
(-1,0,2) or (2/3,5/9,1/3). 
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